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Report  Title 

Image  Science  Research  for  Speckle-based  LADAR  (Speckle  Research  for  3D  Imaging  LADAR) 

ABSTRACT 

We  propose  a  basic  study  of  image  science  topics  related  to  a  new  class  of  speckle-based  laser-ranging  radars  (LADAR).  For  this  imaging 
radar,  we  study  two  basic  system  configurations:  a  wavefront  sensing  configuration  and  an  imaging  configuration.  Three  major  research 
projects  are  (1)  study  of  speckle  patterns  to  establish  3D  qualitative  features  for  a  remote  object,  (2)  study  of  performance  of  this  compact 
ladar  at  photon  counting  light  levels,  and  (3)  space  and  wavelength  dependence  of  speckle  for  a  thick  diffuser.  A  balanced  research  program 
of  theory,  computer  simulations,  and  laboratory  experiments  is  planned.  These  will  feature  low  light  level  speckle  studies  with  tunable/ 
multi-tone  lasers.  For  the  first  area  of  study,  we  develop  a  new  thick  diffuser  for  studies  of  turbidity  and  imaging.  The  diffuser  consists  of 
three  to  five  different  polysterene  spheres  emmersed  in  agar.  Additionally  we  have  published  a  paper  describing  the  first  infrared  hologram 
at  10.6  microns.  It  is  expected  to  be  useful  for  examination  of  silicon  boules.  In  this  study  we  will  employ  machine  vision  techniques  and 
neural  networks  to  ascertain  the  minimum  number  of  photons  that  are  required  to  set  the  boundaries  or  shape  contours  of  a  speckle.  The 
study  of  space  and  wavelength  dependence  of  speckle  for  a  thick  diffuser  is  important  for  assessing  LADAR  system  performance  in  the 
presence  of  fog  or  smoke  in  the  atmosphere.  We  seek  to  establish  the  capacity  for  these  LADARS  to  see  through  turbulences  and  turbidity. 
Major  objectives  of  this  research  are  to  contribute  to  the  understanding  of  speckle  phenomena  and  the  feasibility  of  remote  object 
classification  using  novel  3D-imaging  means. 
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Technology  Transfer 


1 .  The  PI  participated  in  a  visit  to  the  Photnics  Center  at  West  Point  for  the 
purpose  of  reviewing  their  research  program.  In  addition,  he  is  discussing  some 
research  topics  in  speckle  -  LADAR  with  the  Academy  faculty.  This  is  a 
continuing  effort  by  the  PI. 

2.  Both  PI  and  Dr.  Wanli  Chi  are  actively  pursuing  industrial  interactions  with  a 
number  of  companies  including  Hand  Held  Products,  inc./  Minneapolis 
HoneyWell,  and  Micron  inc. 


Summary  of  important  results 

1 .  During  the  past  year,  Micron  inc.  has  started  a  major  preproduction 
development  of  the  logarithmic  aspherical  lens  invented  under  ARO  sponsorship. 
This  development  is  planned  to  lead  to  major  mass  production  starting  at  1 
million  cell  phone  cameras  per  month  and  if  it  is  successful  ramping  up 
production  by  4  fold.  This  effort  has  received  important  technology  transfer  by 
the  PI  and  Micron  has  also  hired  5  graduates  from  U  of  R  and  RIT  to  staff  the 
development.  This  important  result  is  explained  in  detail  in  the  attached  pdf  file 
that  contains  visuals. 

2.  A  particularly  significant  accomplishment  during  the  past  9  months  has  been 
the  discovery  by  Wanli  Chi  of  a  novel  new  camera  system  that  has  particular 
application  to  DoD  and  to  remote  sensing.  It  is  based  on  an  adaptation  of  a 
concept  used  in  X-rays  and  originally  proposed  by  Princeton's  R.  H.  Dicke.  This 
system  is  in  a  formative  state  at  present.  It  has  not  yet  been  reduced  to  a 
practical  system.  Each  component  piece  of  the  Dicke-Chi  camera  is  being  tested 
or  designed  for  later  reduction  to  practice.  This  novel  system  is  described  in  the 
attached  pdf  file  below. 

3.  The  field  correlation  of  radiation  of  radiation  from  thin  diffuser  is  studied  over 
the  whole  right  half  hemisphere.  The  formulas  for  the  speckle  size  are  valid  for 
nonparaxial  whole  half  hemisphere. 

4.  A  comprehensive  review  paper  in  which  we  describe  speckle  in  the  4F  optical 
system  is  published  in  the  Applied  Optics  issue  dedicated  to  Professor  Emmett 
N.  Leith.  Many  phenomena  about  speckle  are  explained  in  an  accurate  elegant 
manner  by  the  choice  of  this  optical  system.  The  troublesome  quadratic  phase 
factors  associated  with  Fresnel  zone  propagation  are  eliminated  in  the  imaging 
and  transform  regimes.  Both  space  and  wavelength  dependence  are  included. 


5.  We  have  developed  a  really  practical  hologram  system  for  the  10  micron 
infrared  wavelength.  The  heart  of  the  system  is  the  use  of  a  microbolometer 
array  for  recording  the  hologram.  We  believe  this  technology  will  have  many 
practical  application  in  production  of  metal  parts  and  silicon  fabrication. 

6.  A  novel  approach  based  on  sampling  theorem  for  studying  eigenvalue 
problems  associated  with  bandlimited  integral  kernels  of  convolution  type  is 
studied  in  detail  and  published  by  Kedar  Khare  in  the  respected  mathematics 
journal  called  inverse  problems.  Dr.  Khare  has  accepted  a  position  as  a  senior 
imaging  scientist  at  the  famous  General  Electric  Research  Laboratory  in  New 
York. 
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INTEGRATED  COMPUTATIONAL  IMAGING  SYSTEM: 

CONCEPT  2 


Concept  explained  by  Dr  George  in  our  group  meeting,  1999 


NEXT  STEP:  logarithmic  asphere(«  lens) 

•  PHYSICAL  CONCEPT-FERMAT’S  PRINCIPLE  3 


CHI  AND  GEORGE,  OPTICS  LETTERS  26,  875  (2001). 


i(j){p) 


Generalized  Theory  for  the  Logarithmic  Asphere  t(p)  =  e~ 


/(p2;s)  = 


\dplnpJ0(-  2^Pl  2) 

o  A0yjt  +  p 
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POINT  SPREAD  FUNCTIONS  FOR  VARIOUS  OBJECT  POINTS 
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IDEAL  LENS  LOG  LENS 
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Comparison  of  maximum  Entropy  methods  f 


7=0,  steepest  ascent; 
y=1 ,  Burch,  Skilling,  Gull; 
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T  w.  chi  and  n.  George,  josa  (2003). 


Transfer  function 


OVERALL  TRANSFER  FUNCTION:  Optics+Digital  7 


+  NEW  DISCOVERY  IMPORTANT  FOR  INFRARED  IMAGING 
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M.E.  Recovery  of  a  Two-Point  Object 

1450mm  1492mm  1500mm  1508mm  1580mm 


Diffraction  Limited  Performance 

8  X  EXTENDED  DEPTH  OF  FIELD 
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M.E.  Recovery  of  a  Picture  Blurred  by  Log  Lens 

Object  distance  at  1580mm 

(Best  focus  plane  at  1500mm) 


Blur  by  Log  lens 


Recovery 


Blur  by  ideal  lens 
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EXTENDED  DEPTH  OF  FIELD  10 

MAJOR  FINDINGS  UNDER  ARO  SPONSORSHIP 

TOPIC  MAJOR  RESULTS 

EXTENDED  DEPTH  OF  FIELD  8  TO  1 0x  CLASSICAL  LIMIT  (Pat  1) 


MAXIMUM  ENTROPY  -  METRIC 
PARAMETER  FORM 


CONSTRAST  ENHANCEMENT  OF 
INFRARED  IMAGERY  IS  SUPERIOR 
THIS  FACT  NEEDS  TO  BE  COUPLED 
TO  NIGHT  VISION  LAB  AND 
TO  HOMELAND  SECURITY 


PROVIDES  SUPERIOR  IMAGE 
RECOVERY  (Patent  2) 

.  THE  RINGING  IS  LOW 

.  THE  MTF  IS  BETTER  THAN 

THE  CLASSICAL  LIMIT 

.  INFRARED  TELESCOPE 


TECHNOLOGY  TRANSFER  EDoF  PROJECT  SUMMARY  11 


STARTUP  CORPORATIONS 

APPLICATION 
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ENVIRONMENT 

PATENTS:  2  GRANTED,  2  PENDING 

(U.S.  Pat.  Nos.  6927922  B2;  7336430  B2) 

MAJOR  INDUSTRIAL  PARTICIPANTS 

•  HANDHELD  PRODUCTS,  INC 

BARCODE  SCANNER 

DIVISION  OF  MINNEAPOLIS/HONEYWELL 


•  MICRON  IMAGING  CORPORATION 
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MODIFIED  DICKE  CAMERA  WITH  DIFFRACTION  EFFECT 
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Starting  A(x,y) 
pattern 


DICKE  CAMERA 
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RESEARCH  AREAS 

APERTURE  DESIGN 

(PERFECT  6  AUTOCORRELATION 
FUNCTION  IS  OPTIMUM) 

•  FRESNEL  ZONE  PLATE 

MERTZ  AND  YOUNG 


•  IMAGING 

I(x)  =  1 /  d)-t(x- 


•  SCATTER-HOLE  ARRAY 

DICKE 

•  UNIFORM  REDUNDANT  ARRAY 


•  PROCESSING 

0{—x/ d)  - 1  t(x')  -I(x'  -  x)dx' 

=  |  ^t(x')'t(x -x- %)dx  0{^/d)d^ 

•  APERTURE,  “RANDOM”  PINHOLE 

-t(x'  -  x-  %)dx'  =  &(x +  £)  +  ... 
0(—x/ d)  — >  0(-x/ d)  + . . . 


FENIMORE  AND  CANNON 

•  PHASE  RETRIEVAL  (DIFFRACTION) 

CHI  AND  GEORGE 

•  PROCESSING  (OPTICAL  &  DIGITAL) 

•  CROSS  CORRELATION 

•  PHOTON  TAGGING  (BACK  PROJECTION) 

•  LINEAR  FILTER 

•  MAXIMUM  ENTROPY 

•  ITERATIVE  REMOVAL  OF  SOURCES 


APERTURE  DESIGN  (CYCLIC  DIFFERENCE  SET) 
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{«! 


is  CDS  if  0  <  al  <  n 


Either  case  i)  all  (ai  -  cij)  •  modn  are  different  for  i^j 


or  case  ii)  for  any 


m  •  mod  n 


there  are  z  pairs  ,  (m-a. 


EXAMPLE:  i)  {0,  5,  6,  9,  19}  n  =  21 

ii)  {0,  1,  2,  4}  ti  =  7,  z  =  2 

dj 

Ex.  m-mod«  =  5,  the  pairs  are  {0,2}  {2,4} 
•••  =1,  .  {1,0}  {2,1} 


Cyclic  autocorrelation 


TWO  SYSTEM  REALIZATIONS  (COMPLETE  CODING) 


EACH  SOURCE  FORMS  SAME  PATTERN 
BUT  SHIFTED  AT  DETECTOR 


EACH  SOURCE  FORMS  DIFFERENT 
PATTERN  (CYCLIC  SHIFTED) 


RECOVERY:  CROSS  CORRELATION 
WITH  APERTURE  (REPEATED 
APERTURE)  GENERATES  THE  SOURCE 
DISTRIBUTION 


RECOVERY:  CYCLIC  CROSS 
CORRELATION  WITH  APERTURE 
GENERATES  SOURCE  DISTRIBUTION 


RESOLUTION  $0  =  M  d 


APERTURES  SATISFY  THE  OPTIMUM  CONDITION 


APERTURE  FUNCTION  t{n)  = 


0 


N 


^t(n) -t[{n-m)- mod  N]  =  a-Snm+b 

m— 0 


MODIFIED  DICKE  CAMERA  WITH  DIFFRACTION  EFFECT 


LG-  Aperture 


■  Detector 
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APERTURE  REQUIREMENT 


d 

-  II  <— 

D  t(x,y) 


CODED 

IMAGE 

PATTERN  GENERATED  ON  DETECTOR  BY  A  POINT  SOURCE 
HAS  OPTIMUM  AUTOCORRELATION  PROPERTY 

t(x,y)  calculation: 

FRESNEL  ZONE  PHASE  RETRIEVAL 


CODING 

PATTERN 


RECOVERY 


FRESNEL 

TRANSFORM 


PATTERN 

CONSTRAINT 

A(x,y) 


FRESNEL  BACK 
PROPAGATION 


( 

1 

APERTURE 

CONSTRAINT 

phase  | 
amplitude] 

i 

i 

t(x,  y)e^x’y) 

ADVANTAGES 
ULTRA-THIN 
LENSLESS 
IMAGING/CODING 
DIFFRACTION  LIMITED 


FRESNEL  BACK 
PROPAGATION 


Starting  A(x,y) 
pattern 


APERTURE  CONSTRAINT  CAN  BE  EITHER  AMPLITUDE  OR  PHASE  CONSTRAINT 


MODIFIED  DICKE  CAMERA 
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PSF 


OBJECT 


IMAGE  (Noise  1%) 


RECOVERY 

(CROSS-CORRELATION) 


ADVANTAGES 
ULTRA-THIN 
LENSLESS 
IMAGING/CODING 
DIFFRACTION  LIMITED 


RESEARCH  TOPICS 

2007-2009  W  CHI 

APERTURE  DESIGN 

PHASE  RETREVAL 
RGB  COLOR 

IMAGE  PROCESSING 

MAX  ENTROPY 

3-D  IMAGING  &  DOF 
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PRINCIPLE: 


RELATED  WORK: 

RANDOM  LENS  IMAGING+ 

Sensor 


DECODING: 


RANDOM  PATTERN  FORMED 
ON  DETECTOR  FOR  A 
SINGLE  POINT  SOURCE 


RESEARCH  TOPICS: 

.  PSEUDO  RANDOM  LENS 
.  DIGITAL  PROCESSING 


i)  SPACE-VARIANT 

MAP  DETECTOR  PATTERN  FOR 
EACH  POINT  IN  OBJECT  SPACE 


RELATED  CODED 
APERTURE  TOPICS: 


ii)  SPACE-INVARIANT 

DEBLURRING  PROBLEM 


Input  Random  lens  output 


.  CYCLIC  DIFFERENCE  SET 
.  PHASE  RETRIEVAL 


IMPULSE  RESPONSE 


+  FERGUS,  TORRALBA,  AND  FREEMAN.  MIT-CSAIL-TR-2006-058 
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RELATED  WORK: 

STRUCTURED  ILLUMINATION  /  SUPERRESOLUTION 


•  SPECKLE  PATTERN  ILLUMINATION 


•  RESULTS 


•  RECORDING 

Of  O)  =  [g(x)  -S(x-£)]*  h(x) 

A  SET  OF  IMAGES  ARE  COLLECTED 

•  DECODING 

0(x)  =  J  Of  (x)  •  S(x  -  =  g(x)  *  [h(x)  •  y(x)\ 

r(x)  =  \s(Z)-s(x+t)dZ 


ONE  SAMPLE  LOW  DECODED  FROM  A 
RESOLUTION  IMAGE  SET  OF  IMAGES 

•  RESEARCH  TOPICS 

ILLUMINATION  PATTERN 

•  CYCLIC  DIFFERENCE  SET 

•  REMOVAL  OF  IRREGULARITIES 


GARCIA,  ZALEVSKY,  AND  FIXLER.  OPT.  EXP.  13,  6073  (2005) 


TWO  DIMENSIONAL  UNIFORMLY  REDUNDANT  ARRAY 


URA:  Ideal  cyclic  auto-correlation  property 
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A(i  j)  is  a  uniformly  redundant  array  of  size  RXS 

R,  S  are  two  prime  numbers,  R-S=2. 


f  0  if  i=0 


V_ 


1  if  j=0  &  i^O 

1  if  CR(i)CsG)=1 

0  Otherwise, 


where 
CR(i)  = 


"1  if  there  exists  an  integer  x,  1<x<R 
such  that  i  =  (x2)-modR 
L  -1  Otherwise 


and 
Cs(i)  = 


"1  if  there  exists  an  integer  x,  1<x<S 
such  that  i  =  (x2)-modS 
L  -1  Otherwise. 


Research  Topic: 

Three  or  more  2-D  arrays  for  color  imaging 


First  applied  to  coded  aperture  by  Fennimore  and  Cannon 


Examples 


5x3 


61x59 


0  0  0 
1  1  0 
1  0  1 
1  0  1 
1  1  0 


PHASE  SCREEN  PATTERN:  PHASE  RETRIEVAL 
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Actual  detector  pattern 


Limiting  factor:  the  pixel  size  of  phase  screen  (RESEARCH  TOPIC) 


Negligible  effect  on  image  quality 


IMAGING  SIMULATION:  IDEAL  AND  ACTUAL  PHASE  SCREEN 
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OBJECT  RECOVERY  RECOVERY 

(IDEAL)  (LCD  PIXEL  8  MICRONS) 


(  )  In  the  case  of  8pm  pixel  phase  screen,  the  actual  detector  pattern  is  used  for 
imaging,  and  the  ideal  detector  pattern  is  used  for  recovery. 

O  A  simple  cross-correlation  method  is  used. 

O  Negligible  deleterious  effect  on  image  quality  is  observed  in  actual  8pm  pixel 
screen  compared  to  ideal  theoretic  one. 


NOVEL  DICKE-CHI  CAMERA 
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PRELIMINARY  DESIGN 
(MONOCHROMATIC  ILLUMINATION) 

LCD  screen 

Reflective  phase  type 
1920X1080  pixels 
Pixel  size  8.1pm 


LCD 


CMOS 


1024X1024  pixels 
pixel  size  10pm 


Current  Status 

Theory  finished  (Monochromatic  illumination) 

Successful  computer  simulations  completed  (2/2008)  in  first 
contract 


PROPOSAL  on  CODED  APERTURE  IMAGING  SPECTROMETER14 

I _  B 


Object 


Monochromatic 
detector  array 

O  Dicke  camera  in  optical  regime 

Cross-correlation  signal  processing  (Repeat  for  all  wavelength) 

^  AO  ^ 

O  Spectral  resolution  A/t  = - 

2n (n  - 1  )<Jh 

O  Can  be  lensless 


D 


O  Color  imaging  without  Bayer’s  filter 

Better  color  rendition  than  RGB 


Research  Topics:  aperture  pattern  &  contrast;  digital  processing 


